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ABSIEACT ^ • . ' ' . 

• ' At tiie^niversity of Illinois ajt Orbanar .a computer 
based curricuiuc called Autcaated Coaputer Science Education Systeii • 
.(ACSES) has been developed to suppleiaent instruction in introductory 
qonputer sci,ence courses or to assisl^ individuals interested in 
acquiring a foundation in coBputer science through independent study. 
Tbe systea^ which uses PLATO 'teraj^als, is presently in routine use 
it several courses at the • University of Illinois^ and it has been 

3ed at .Wright Coaaunity College in Chicago. Becent changes in 
piogra»ing and technical^ innovations have increased ^its instructiotial 
effectiveness. The first' section- of th£^ repoj:t describes the goals 
anB design of ACSES. Lat^r sections provide yearly reviews of 
prdgrgss aade for 'the duration of a grant froa th'e national Science 
Foundation. (rliH) 



Documents acquired by EHIC include aany inforaal unpublished * 
materials not available from pther sources. EBIC aakes every effort 
to obtain the best copy available. Nevertheless^ items of marginal 
reprgducibility ate often encountered and this affects the quality 
of the microfiche and hardcop;^ reproductions EBIC aakes available 
via the ^RIC Document Reproduction Service . (EDBS^ . tDBS is not 
responsible for the quality of the original document. Be productions * 
supplied fay EDBS are the best 'that can-'^be made from the original. * 
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r ' 1 , * ' , 

This 'first section T^rovides i criei .aescription ^tne • - \ . 

deslpt^' fiTrd, goals of the Autpisatel :c«nputer Science Education Systen '^AC3E3', 

and a saTrtsry of its c^-irrent s^atus^.* The. next three sections provide ' 

yearly re%i.evs of progress jrade ^ovard this current staphs-* iurirt^r -the .- 

duration of the grant. Section is a tibliography of papers and 

' reports produced by nenibers of •i^he AC3ES project. • . • . 

A slightly r.ore detailed; sarr^ar^^- of the principle "components 
•* * . . ^ 

' of the syste-r. is contained in ^^(ieVergelt, .J et: al, 19^6j. Cor.plete 

zetai^s c>f varices :o-ponento ray be foun^ in one or r.ore cf tr.e publications 
• . -listed in irec^.i-n^. ' , ' ^ . 

. * • ' . * Review ^of th-e x^yo^^cz and its £oals ' 
\ " * • : ' ; '' - / .. . \ . 

* \ i '*Cver th^ ^pasj: three years,, th^ Departnent of Tati^nter iScxenco^ v. 

-PS been ted'/ilv engaged 2« a proj-ect to ^e-^lc^^OTi PIATO an ^.nstruc^iqh^I 

s^st^^T^. carain^ of . assvrrdc^s a larce' '^i?:'. the. teacning load-in ^ii.^ts - . : 

intrcductcr-.- Drorrarj^ng ^;purs95. Beginnlr^, oanuaH a, 'l/^i^/ this pro^e^ 

has been Dartiallv s aborted, by ?:3? under givanx^ EC -^Ip^i V^-SP?-' 7^-215^-- . .• 

^ - • V The .T.a:or goals of the procecr.^vz^re-i^ . ' ^/ > ^ ^ r - 

/ . ^ • the system should be ^j^ef^ul a.6 a suppler^eno to . ^ ^ , 

' !' » . ^ J cLassroojn instruction in any introducltbry conputer . 

|- • ' ' . '/ science course-lno^jnatter what programrang -language 

'V . • ' ' iS'-t^L^ji^jt^ vhat exa.'?5)les of coinputer applications - ^ - 

■ . ^* I " ~ ■ are-viiscfuss^, -and what the instructor's philosophy 

, ' • ' ; • ' is about ^.dwiprogrsinming. should be taught. ' / 

^' / ' \ ; ' ,--';the -s/s fern, should 'jie^^iable to provida, at least ^ naif; , 

. 'v ' V ' ' o'f ^the instr^ifction in any one of "our ovm introduclpry^ 

^ ^ ' ' • ^ . C5.eeurse5:(-currentiy, Ci-S. 101, 102, 103, 10^, lp6, ^ 
. \ 'l6i; ^1, 'artd' C .sV k)0) . - ^ 
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^ . V' ' .^v, the system shoul4 be usable without an instructo^ by 

-.^/^ ' . ' \ anyone having ai:ces3,'to a PLATO terminal wrio want3 to 

r^*'" • learn the beginnings of coniputer science on his pwn. 

* , , V 1< ^ ' ' . . , ^ 1 • • - • - 

/..■•: /.. ■ ■ ■ ■ ' •■ . 



^ ne car. 3urrarize these pcvr.t? • :a"irj^ *,r.at tr-e ir^str ^cticr.a. cv^^.e-t 

# 

c-" aUwCr,a*icV. i-3*er.7.1ned cv the ip3*ruc*cr^ acv^ll as ir. a :*^^y ' 

« 4 

aa*tor.atei r.oie-. 

These gca'ls have causei -is to .organize the ir.str-ictional syster. 
as a. collection of 'relati\^'ly in'iepender.t ani seli^-containei ccrnpcr.er.ts . 
The OLcecti'/e has not fce^n tt^'^'ta.^e one ox" our existing C3 courses and put 
it or. TL.-.'F: as it is. Father, ve wanted to t'orn a ?LAT^^ terminal into 
a ricn envircrj\ent , analogous to a con^ntional licrary and lacoratorv, 
vh-re one : as at cne^s fin^ertip^ -any useful thinrs f<Tr learning acc.t- 
"c-rrer scien?e, and for r)racticinG irr.eiiately vhat one has lesrnei. 
It is -.he s-.uienx anu his instructor who decide •..-hich of th&s- thir.gs 

they vant to use. , ^ 

The principle components of kCoEo which alla^' this flexibility 
are: The lesson library, with a classification scheme in vrlch an^' " . 

self-contained lesson about introductory ccr.puter science v.-ill -fit: the 
guide, an inforrr.ation and advising' system which ^.i'^es the user ^access _ , 
to t-is library and allo-^s an ad;r.inistrator to l79.ep track of ' all his les-sons 
^nd their interrelationships; and the prograrirdng system, on v:hich^an. 
additional progra-^uning language can be implemented in 'a few man-rr.onths 
(by •sorr;ebody fa^Tdliar' with ^ the system), and in which all user^dialog ^ 
'(progra/ri entry and ed'itiqg, ^error-analysis, and execution modes) is carried 
out in a uniform way, independent^^ of the particular prograrrmmg language 



^^^S' involved. 

^ ^ - ^3* out not least, the project had one rnore important goal: 

' >* 
■ to serve as a stirulating enviroaT,ent for computer 
scie-nce research in a variety of areas: compilers, _ - > 

infonhatiofv, sy^ter-.s^ -artificial intelligence. ^ 

« 

% 
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rr.i3 last point --ay ieser"*^ sor-e e>xlar,ation, since the niis concept ion 
is v-llesr>reai "rr.at lesson vritir.^;: is a ro^j^tice acti\i.ty. It car. ce, if 

* - •. ' \ • 

cne creates rocr lessens. It car. also ce. a t$ts:< as cbeiier^n^^ as one 
visr.es to ra.-'e it, if ' one -.i.e-A^s a lesfecn as ax* interactive uTOzfar. tjnat 
has a certain ior.ain*of kna^^iei^, and is ai:;le ro ccrr.unicate. with 
students acc^t the >nwledge it has- 

1.2. S'JL'^r^arv of C'irrent stat ..2 



Cur exT'erience vi-^h \ZZ^'S. and the staves cf the .•'.a.jor ccriponents 
of th-r sTSte-, r.ay ce £'u."ari2ei as fcllc-^'3' 

'1 The svste-'' is in rc*;tipe use for 'several cf c jt ' introiuovor'.' 
p?'ogra-ur.iaf; ccurses /:.3. lOi; 102, 103; -0^; and -00 >' -In j'.S. 105 alna 
IG';, kZSZS is used to replace one lecfc^ore each'-^'ee'^. with each stuoent 
^penling about one hour vee>ly at a PL-.TC ter-inal: O.S: Ipl feri 1C2 h.aye :^ 
so far -"l^sed- AC 3 as s-uppler-entar;^^ -?tterial only; CS. -05 is ta^j^ht 
'•DrL-.arily via>.CS3. All told, nearly 1,3Q0 corip^uter science .students per, 
se^.ester are rriaking contact vith FMTO". ' - 

, "Controlled exDeriments have vindicated that' stud^ts In FLVTO ^ \ • ' 

sections learned as much &s those in non-PLAT^ sections; asd. /^uid .strongl\f'' 

• • * * . * 

rev-oiT'^.end FL^TO sections to their friends, but dropped a 30raov:nat ^ 
^ ' . • . • ■ " .• • < ^ ' ' • . ' • " 

higher rate. , \, • ^ ^\ 

.1. ^ J ^ r * 

As an indication or the', ^cceptanc^ of PLATO, within 'iapartnient^.. 

in Fall 1976, C-.S. 101 and^CS. 105 will each have one^les? prdf^fe^r^'-* ^ ^\ \ 

assigned than usual, with the" remaining ^.nStructipnal Idai t^kej^'up'by AC^o'.'- 



3 - ' 



' . - •'3 • -:.f^er ccnsiierablc effort, we have ceer. succe^s.f-jLl in 

* CJSt-:ir.5 another ir.c^itution to ^a--e re-'-jilar use cf ACC^S. 'j^Jirinr: tr.^ ' * 

ac^ie-.ic j-ear I;'''^;-'^^^ o\^r 55: stiients ir. five sections of thi^e cc-orsec 
^* ' • • . ' 

' y at V.'rifi-it Cot Jinity Tclle^^e ir. Chicago have receivei part of their 

instruction cy vay of 0ir.syste">. . • - 

"l\ Tee lesson licrarr has rrcr-'n to ac-cut 1?5 ^esscns, grouped 
into aic^t 21 areac, ap.d continue3 to expand slovly. In addition, we are 
-.a<in;: svsteratic efforts to itrrove the q.alitv of the lessons cased on o-ur 
^* expc-rience. vi:n their ^se in instruction. 

' - ^rne :c-pj:ter azci^tei prar,r3:^-inF syster. (CA?:^ is operational 
an' r.ns ?! 1 . ^ '-7?^::, ^Tr':, RAXAL, rAZ::/ar>i IIC^ prorra-s . CAPS 
.rrcv.ies a^tc^atic anal:, sio of errprs at both ccr-pile -tir.e and run-tlT.e^ 
' . , in-'eracting u^th the student to h^lp hir. find >h£ cause oT his error. ^. • . 
" : : ^----^c^tunatolv, the' usabiiitv of th!^s system has been severely ha^-r/pe^ed by 

X the pro'-^osin.^ •liriitations'ir.posel by FLAT"'.* We have thus aevotH a great*. ^ 

* *\ • • * ' ^ " ■ ' • * ' ' J * - ' 

. deaJ. of study and wcrK. to developing techniques , to ir^.prcve . the Efficiency 

oi^ the syster.. ' \ > . ^ • ^ 



■""'5^ Tne inf orr^tion- aod advising svfeterr., c'^ui/ie^ corripiete.> 
.hf^' e'-'iSl'e i'S./i'isi^'r.e-i to jr.akfe AC SSS .usable b/ people- who want to ^ydy , / / 



. oa'tV.ei^ cr..T., bv e<yising thes^/ cfn 'tr^ir choice of' lessons based oc^t-heirr- * 
' . • * qo^Li.s-s-ani pa^t p^rfo^sjience . . It corrL™TiiT5a^es.J)r'imariir by means of sr;npl^,.. 

*• •* • . ' r . ^ *^ . . ^ ' 

. ►'.'■>^gli;b pV:r&s5e as -i^ifii, ^rd pi£ture« • f.dr output, where -the .i-elatiQjishijps ,V . 

r.-* a'5^:V: le^§Qn^.^I.relevance.,-eo the u^erl are- dispJ^ayfed in grap 

V ''i:/': . V V ' -.V"/.' \' in■%r>othor^'ise*of.,AC^TSo•^■laterial i(5qi}side our^ 

//V H . * cai b'eerj'^&icptAd ^y, i^e " FLATO foreign language group to 'administer their ..^l^ ' > 
' coUe'cti'orf 'br->es^oQ3 . : • , ' ■ ' ;;, ' :, ' 



graphic^ form. ' V ; 
.group,; the gui^eV . '1'' 
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^6} An in^erac^ive exari system., iesignei-i*or auoor-atic 
generation ani adr.inisi;ration of exars, has been cor-pletei, allhourx 
there is Svill need of additional probler. generators and graders* 've 
have conducted several experiments invol\'lng the exa;n system/ and are 
conducting anothei^ in 3irrr:er-19T6. As a part of the exaxn sy^ten, a quiz ^ 
system designed to assess and control the student ^s progress through 
various lessons 'has *been inpler^ented. Many lessons have had such qui-zzes 
written, and ve are continuing to write more. 

{^] SxperLT.entation on the design of control struct'ja:e5 for 
interactive T^rogramnving languages, partic^olarly in CAI^ has been corr.pleted. 
^hi5 work has led to the developT.ent of several principles ('^iforn^ity, 
separability, and locality) which are proposed as a partial basis for the 
design of prograjrjning language features « 

(8) Two lessons concerned with judging student progra.ms have 
been essentially' completed, and work on determining techniques for detecting 
'various anomalies in- Student progra^^s by glo\)al flow a^ialyses has been 
significantly advanced. 



I ■ 
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2. Activitie3; Januar y, 171^ - -Jurfe, IQlh ^ 

2.1. The librae/ lessons 

\ ' Durin^^ this period the library has growq from 50 to aboiit 90 
lessons which are in some sense 'operational", 'and, more importantly, 
many of the lessons /nave been improved. Much of this effort (by ri. G. 
Friedman, R. G. Montanelli, D. Eland and S. Leach) has been directed 
voward polishing elements of the FORTRAN sequence and improving 
csrouter in preparation for the PLATO experiment ^ in CS 103 this fall. 

Arionp; the ir.prcvements to the lessons has been a certain 
arcunt of standardization. For e<ample, the function of the keys 
tnat allpv a student to control his path through a. lesion has been 
standardized among all CS lessons, s-o that a student who has gohe 
through a fev lessons has become familiar with most of the control 
options in all lessons and can proceed tlirough subsequent lessons more^ 
easily. Tnese conventions are described in lesson csauthors (?• 
Izquierdo)*. Standard pieces of code, character sets, and micro tables 
have been collected in lesson cslibrary (H. Friedman) • 

Also, several commonacation lessons have been completed. 
Lesson csnotes serves a "bulletin board" function between authors. 
Lesson cscomments (D. Eland^ E. Reingold) serves to record -remarks 
made by students taking instructional lessons, for feedback to the 
authors of ^the -lessons. Lesson cst-^lk (H. G.' Friedman) allows real- 
time communication between as\ instructor and each' of several studefits; 
this allows human assistance to a student by an instructor who might 
be located ^at a different PLATO siter 

/ 

■ 9 " . 



* ♦ ^ 

2.2. C omputer as^isted^prop,ramjninf3 system (CAPS) ^ ^ 

. A table-driven program entry and editirfg and syntax analysis _ — 

program has been completed (T. R. Wilcox, A. Dav^s, M. Tindal],-). Tables^* 
for. PL/1 are compl^ete. Tables for FORTRAN, BASIC, COBOL, SNOBOL, APL, 
and Mrx have been started. Program entry and ^diting are^ work ilig- for 
FORTRAN, COBOL, and BASIC. " . • ^' " ^ 

The run time^ system for each of these larrg\5ages is different. 
The PL/1 run time system works for a subset of PL/l suitable for the 
first half of one semester's instruction, ^nd is being used> this semester 
in on^ introductory course, CS 10^^. Run time systems for FORTRAN aad 
BASIC are in progress, and COBOL has been completed* » i 

M. Tindali.has imp5.emented. a prototype version of an automatic 
syntax error analysis scheme; this prototype system is, installed in ^a 
developmental version of the general compiler system and works moderately 
well on the PL/l language and tables, "lie is currently attempting to 
i achieve this same working level with the FORTRAN languag'e and tables (and, 
' perhaps, the COBOL language). VJhen this is accomplished, he will revise 
and refine the prototype model .to obtain' a stable, ^operational version of 
the compiler with the automatic error analysis system included. 

'A. Davis has expanded his execution supervisor for PL/l to 
it*lude characte'/ variables and -their associated operators and built- >^ 
'in functions: concatenation, INDEX*, SUBSTR, LENGTH, and. VERIFY. The 
necessary changes wer^also made to the PL/l syntax fables. Because 
of space limitations 'imposed by PLATo) it seems unlikely there will be 

any immediate expansion of the subset of PL'/I executed. Presently, the 

s 

statement types accepted include PBOCEDURE, DECLARE, assignment, IF THEN 
ELSE, GOTO, Db (all forms), GET "LIST, PUT LIST, and END. 

' iO . • 
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About 8C^o of the "eJ^cution-time errorVnalysis system has 
* « 
been coded and debugged. Despite delays caused by the previ^ously ^' ^ - 

mentioned space limitations,^ completiQn of the ruh-time analysis package * 

is expected before the end of the calender yoar. ^ . \ 
^ ^ , , ' t. " ' 

' B. Segal is conductlngva study to.ex$>lore the effect, of system^ 

interruptions on user performance at- a .terminal. Our compilers interrupt 

the< student who' is typing a jprogram at the very moment he makes an error 

that can be detected, by the compil-er,, and we would like touknow whether - 

or not this is a more effective way than the conventional approa^ch, 

where all errc>rs are signaled when the program has been entered completely. 

A pilot study has been ''completed ^and results show some' 

statistically significant differences between the two error interruption 

methods; a full-^cale experim^nj: -frill- be carried out^ in October. 

2.3. ^ Information and advising^ system . ' ' 

' A ^version of^the GUIDE conversational informsLtion system, 
designed to advise studentsin their choice of lessons -based on theip 
goals and past performknce, is, currently operational. • A student can 
ttpe in a request for information/,'^ English sentence), and the 
^ system will respond by displaying the desired information (or an 
explanation will be given as to why the request could not be handled). 

The first part of the GUIDE, the translator, has been completed 
as part of a ph.D. thesis by/j. Pradels. A request in English isx ^ 
translated into^an internal request language by means of a finite state 
automaton. This internal^ representation is t^ranslated back into English, 
so that. the' user can judge for himself whether his Vequest has been . • 
properly understood. 



' i . 

D." EWnd has implemented a .request processor which analyzes 

■ the intermediate repi;esentation qS the original request, se^rch'es the 

proper data^b.ases Tqt the desired informati'on, and generates a "display 
•jwhich presents an appropriate response to the student: In addition, 

"he has completed detailed design of the ^entire data base for the system. . 
• A data base editor has been .impleme;ated which facilitatQ^ fhe entry of ^ 

informeftion, maintains internal consistency, and manages -the allocation 
'4Df storage. Information on each lesson in the library and several course . 

outlines have been entered in the data base, and/outinfes to manage . ^ 

cbllection ah(J display of student .'record data have been."written. 

»> ^ ^ 

Current work on the, systeni^includes monitoring, its performance j 

' • * • •< ' ■ 

under student use, -development of a thorough description of-eac'n lesson 

in 'the 'library (with particular emphasis on the structure of relationships . 

between lessons), an4 research inta the^ content'' and structure of the 

concept, space describing the'j^isiipline of computer science." ^ 
♦ \ , ^ ^ 

' Exam system . * ^ - " ' " — * 

i. Eland has written a program called ex^madmin to handle all V 
security y4nd data .collection aspects of exams given on PLATO. He has 
also yr/tt.en a'protot^e PL/1 exam. Two efforts have been started* toward 
automa/ip problem generators. F. Izquierdo has nearly comple'te<J actable- 
driven generator of single statements, of specified type and complexity, 
in any of the programming languages implemented in the CAPS interactive 
programming system. This program will be used together with a question, 
generator and related grader, to produce a variety of test questions* / 
using single statements. 

B. Barta haVbegtm vrork on an 'interactive .system for automati-c ^ 
examination of programming skills using th</ CAPS system for checking 
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and f-railnc prcsra-'tS' prepared by s^uden^s. ' Tne, student 1a>ir..7 **:he exar. 
types" in a prc^rar. as a solution and >eeps inte^atinc >4^h ^he zyzzen 
un^il either the syszeit accepts the solution as correct., or the student 
decides to q^t. The sepja^nce of , interactions and the ^ding criteria* 
are partly specified by the problem autnor and smartly built into the . 
System. The instructot 'p^^^scribing the examina'trion vill have sor.e 
controlTon the scoring criteria. , • 

,2.?. Auto.niatic .-adgin^ of student progr^ans^ , 

I V.oS'^. is under-^'ay cn tvo Wessons vhich asV: the student to 
'.v-rite fairly sopnicticated*prorrar.3 and attep.it tc Jud^e there ^^"^^'^"^ 
interactively. ... , . . 

One of these fR. Danielson; asks the student to write a ?L/1 ^ 
procram for synibolic differentiation, and is operational in a protct^oDe 

^forrn. Current efforts are concerned with refining tne protot;>T)e ' s 
reaction to student inputs. Tvo approaches are being taken: (l' protocol 
analysis of sessions on" the symbolic differentiation problem between 
intr>oductoi;y-level students ^fnd human tutors, as an aid to aetermining 
valid solutions and aligning the natural language understanding routines 
with statements used by beginning programming students^ and (2) closely 
supervised student use of the machine tutor, to improve the operational 
aspects of the stude^nt-tutor interface. . • ^ 

The other (P- Mateti) is intended to be able to judge arbii:rary 
sorting prograjns written in a specialized language. An editor^nd 
interpreter have been written'for this special programming lang^aage^'- 
and for an assert ic^n ^language in which assertions can be made about the 
state of the array tcx-tfe sorted. These routines 'are being reviewed in 

..-^ 13" ■ ^ 

- 10 - ' 
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J ' an atterrot to ir.vrcve tnfeir effi^iencv. and design .efforts have repjn 
* on a^ theor&t prcver which vill use the assertions to prove or disprove 
the corre^tnes's of the sortir^ij program:. 

\ 2.*6; rr.e :<AIL project ''"^ 

• •Tne ob,ie€tive of the YAIL project is to propose an alternative 

to the TJIO? >anr7aage in the PLATO environnient. In designing KAIL, 

eriphasis has been placed on providing a goM structure for the language 

since this is the erea in vhicn TVTOR is weaken. Thus, KAIL is an 

AL30L-li!<e superset of Z'JZZ?. vitn procedures, clock- structure, and 

•score rules for variables, nodif icaticns, arid user defined interrupts, 

A subset of ?LA.IL vas chosen for in:pler*entation and a compiler 

has been designed^ LT.pler.ented, and debugged ^D,. Zhbley, V;. Hansen,. 

Tne output of the. ccrpiler is TICOR code vhich is c5h^ensed and nan 

on the PLATO system, Zxperir.ents are being designed to determine if 

these new feavures are easier to understand and use thaxi traditional 

• > 
features, as reDresented in TL*TOR. 

2.7. Use of ACSES in instruction 

The system has been used in several courses. ' The most 
extensive use involved .about sixty students (one-half the- class) v/ho 
learned PL/1 on PLATO in CS 121 in the fall of 1<^3' This two month 
trial was used to test procedures for a later controlled experiment and 
to evaluate the existing PL/1 lessons. Tentative conclusions' from the 
experiment vere that students rea^d favorably to PLATO and learned 
as much as students in the regular sections, even though the lessons 
were still in need of improvement. This latter finding is only a^ 
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slight indica^icn znaz zne existing lessons were cr. a par with tne 
oeachin-g assistan^s in teaching r'L/l, as students vere not randcrJ.y 
assigned z6 rrc^.ps, and other experimental ccptrols vere lac'rcing. 

, In the sprinr of 1??-, the instructional systers vas used in 
an a*i:<iliary node in tvc introductor:.* co"»jLrses^ CS 103 and C3 lOo, and 
•also in CS 211. ' . . 





We currently nave over 100 lessons, grouped into ab'Cut 20^ 
areas. Tne r.a;ority of ^hen vere created by students as tern projects 
in a course on, conputer-assisted instruction, or as other academic 
activities, such as theses/ Considering ^his origin, it is understandable 
tha-o many of these lessons are of poor qualify. Considering their 
nunicer, it is also ^^.derstandable that ve do not have the nianpover to 
crinr all of zhen up to a sufficient level of quality. 

rne need for repeated revision based on $;cperience xith actual 
insurucuion, and the significant aniount of effort required for each 

t 

revision, are zhe causes for the fact that only a fraction of our lessons 
are an:rrfhere close zo their "final form". We have raany lessens that 
have ne%'er been used in instruction, and .are unlikely to be used in our 
ovn courses in the near future, since the library has grown to a size 
beycn^d our needs. 

Until further uses^f ACSES appear^ we have concentrated most 
of .our resources for lesson inprovement on the following core of about 
5C lessons-: ■ _ ' ' , 

1) FORTRM sequence '(used in CS 101, CS 103, CS 105, CS i^OO). 
21 PL/1 'sequence (used in CS 106, CS 107*, CS 121, CS 300). 
3) Lessons on cdinputer applications statable^ for these courses. 

t 

k) I^guage-ihdeptndent "lessons on progranming principles. 

- Also,^we plan to introduce into -ACSES some tighter means of 

controlling the student's progress through his course, and giving him 

certain options only af-6er he has ccmpleted important assighihents. ■ 

' 3 ■ . 



Because of our goal to create an instructional systeis that could be 
accepted in any school, ACSrS has been designed ^iccording tc the 
philosophy appropriate for an informa^ion system: if someone is,,.' 
sufficiently motivated to do so, he should be able to^ extract from . • 
the system the relevant inforn^tion he vants^; the systsn should offer 
a large number of choices, and it should never impose itself Iry forcing 
the user to do anything he may no^ vish^ to dp. Tnis philosophy is 
appropriate for seme uses of an instructional systei£'(e,g. , adult 
continuing educatiort;, but a nore structured syster. is likely to 
more effective for teaching large introduptory courses that, are • 
reouired, vhere a large number of* students are not self Tripotivajed. 

•K* G. Friedman manages, the library of lessons,. vilJh the 
assistance of 5. Leach* The FORTRAIi sequence, which is our best , 
tested set of lessons, is supervised by R. G. Montanelli, Jr.*; • ' ^ 

; - ' •• \ 

3.2. Computer assisted programming system .(CAPS ) 

The table-driven programming system, is opei'ational an^ tuns 
for subsets 'Of PL/1, FORTRAN, and COBOL suitable .for a" first programming 
course. • The FORTRAIJ processor, implemented by M. Milner, was used last 
semester by 6OO students in CS 105 for about one hour per week. The 
COBOL processor was implemented as part of an M.S. thesis by R. Barnett. 
As part pf their Ph.D. research, A. Davis and M. Tindall have completed 
an error-ahalysis'' system (for ruh-time and syntax ^errors, respectively), 
/which carrxfe-S ou^ a dialog to lielp the student find the cause of the 
error and correct it; , . ^ - ^ 

Pl/1,' FORTRAN and COBOL constitute the core^'of our progxanffliing 
system that must be maintained in reliable form. Other efforts are - 
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goine on viiich are not> essential ' for the uce of tne programing system- 
in'our ovn coarses: LTpler.entat£or;s of Pascal, ?A3TC, ana LIS?, arfi a 
table-driven interpreter. ^These nay or nay not lead! to usefiil products 
in ohe ne&r future. ^ . - — ^ , . • 

* Tne (efficiency of the programming s^-sten ik of continuing 
concern zo bs. Prior to the expansion , of PLATO'S Extended Core Storage 
i.rsiilior. vTOrds, the nerrfory requirement of the. nrograiming system 
'^aae.its use iirficult^ cu^ since Jebruar/ this problem has disappeared. 
ViO-w xne C?J-tlr.e requiren'.ent^ of ^ne prografeming sys^^m ma^e its use 
unpJ^asant vhen there aVe^^X acti'/e terrdnals.^ V.e hfve iniproved the 
efficiency of the progra^nning system in a variety of vays, for exaitole 
by adding a mode -^liere synta!^ is performed lin^by-3,ine instead of > 
-riVracter-by-character. Tnis version of FORTRAI.' is being used this 
se'niester by ^50 CS 105 students. CERL has c<:^6perated in this effort 
by. 5'--t>'odu'^Lnr^ a-ti^A TUTOa'.feature; 'Vertical segment" which .makes 
taT>ie-lo6?t-UT5 op^ration^' i;^.u-£h fasi^r. Despite these efforts, the ^ 
pro^*yami:^inc^ system' oft^n forces the'Si;»udent ^o gp slower. th^n he • 
coald. Z^.^-^vliite is^^cyrrently engaged in a cai^eful; analysis of the 
FORTBAII processor: In an attempt to isolate "and then improve the time- 
"con'sujning porti'otr"^" of . the,^st^m# , - ' * 



'3*3. . Information and a^/Asiny jsystem ^ - - 

^ The csguide inforraatibn system, has- Beep completed by D. Eland 

-as part of his Ph.D. triesis.- csfeuide' ccrt^imunicat^ primarily by means 
of simple English phrases as input; a*i ijiotures, for^'oxitput, where the 
relationships among lessons of relevance" to the itudent are displayed 
in graphic form. . ' ' - 
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cscJide vas'desicned to Dake ACSES usable by scriebcd:- vt.c 
. vants to stuciy on his ovn. .vrnere students are fcr-nally enrolled in 
ou^ ""3 -curses, the instrac^or carries out rar.y of ^he func^ions for 
vhich -csguide was designed^ ^nd hence csguide nas noo oeen usea n:ucn 
so far. It ^4ll only serve rts purpose if ACSE3 attracts an audience* 
at remote sires. . * \ , 

Tne csguide data^ba^e is also used in the routing and control 
of students "u3Ang rhe <:o5puter sci^i^e lessons on-PLATC. A^iew 
additions ^o this data We have there>^re been made by H. G. rrie±nan 
tp enable ncre flexible routing of students. Alsc^, the info rr.at ion 
nai-nraine'd in the routing process ^bout each student's progress has 
been made available in a lesson, csWords, in a fcrrr. in vhich it can 
be revie^Aed by an instructor. ' ^ • . 

The guide's ability to respond to student requests and quickly 
' ■ and concisely present information via graphic displays has resulted in ' 
the core routines being adopted by the PIATO foreign language group 
to administer thoir collection of lessons. 

. « 

3.i*. Exain system 

As part of -the emphasis to develop those aspeQts of ACSES that 
are of direct use in our ovm courses, various prograjns that have to do 
with exams (an, interactive program grader written by B. Barta, a 
problem generator by F. Izquierdo, an execm administrator by D. Eland) 
.have been integrand intb an exam system by L. Whitlock. Tne system 
is organized' around a central monitor responsible for -record keeping, 
and uses a number, of "problem generator/graderS", each responsible 
for generating a problem and grading the answer. 

• ■ - 16. - 
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?v:o e-:ar,s f-pr ICl v-ifre adT^r.i'stered using the e:<a:n S'sszer. 
aur;.r.g sW-r.er, l^T". ?• ::>ori.y7, Ir- vrni^lce>'; and v;. Hansen hate - : 
conducued an ex::erir.enz this fall to cczpare tne tir.e students spena 
taking an exar. cn FLf-.ZZ vith that spent on a pencil and paper exan. 

V • ' • 

Tnese e^eriences have been used to LT.prGve the h^jnanvinterface of the' 
exa:c syster., * , . -.'^ ."^ 

'-p^yp cu^^ently several TDeoble* vor?.lng on additional 
proclen ^^enerators for the syster., sonie of which will accept a ^ 
"difficultv" ::arar.eter and renerate problem of that relative difficulty. . 
because of the vile variety of problenis that vill be available, the :* 
svsten can be used for exar^, fcr student review, and for experiments* 
v;e intend to exTDlore the acceptability of exams where the difficulty 
of problems is varied during the exan in reaction to previous responses. 

* ■»* • 

1,5. Automatic -rudrr inr; of student programs ^ ^ J 

z ^ ^ , ' 

This past* year ve have continued to wor'K on two- lessons for 
j-'jdring student programs, and, have" just begun another effort in that 
direction. 

The recently cc^;pleted lesson by R. Danielscn tries to follow 

the student's thou^^ht prfeesses as he develops a PL/1 program for 

symbolic dif ferentiStior?^:ofA^>:p>^essions by the teclinique o> stepwise 

refinement of the probljS^. An AIJD-OR graph* is used as a mo<iel of the 

t i 

refinement process, oA^hs traversed by the lesson in the course of . 

t. ' ^ 

monitoring program dev§io]xnent. ^ ^ ^ , 

As part 9f his thesis research, P. Mateti i^ completing a 
program which will be capable of .proving the correctness (or incorrectness, 
^with counterexample) of an arbitrary sorting program written xn a^ ^ 
langiaage with- specially designed sorting primitives (e>R> . interchai:]j^e ) , 
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and incluiin/^ at various. pointc in the proFran, appropriate assertions 
Voout the s^ate of the array teinc sorted. A program entry and nonitorin 
7.0'iule has been ccr.pleted which provides a dynamic display of pro.tran 
execution. A SDecial theorem prover, wliich is highly eff^.cient for the 
restricted aonain of programs being considered, is being Lxplemented 
tc^ ci)^nplet'e this Ifsson. 

^ A third project in judging student programs has recently, been 
started by V;. Gillett. It is concerned with those legal programmj^g 
constructs -^tiich probably indicate a lack of understa<iding by the 
student ^e.z-^ 3*^1/2, which is equivalent to 3/2). A stud^r is under/.*ay 
to identify and categorize these "conceptual error^'j^ ahd a system is 
being designed which will scan arbi-trar^' student FORTRATi prbgrams for 
such errors, describe them to the student,, and proyid^' adVice and'vhints 
on how they should be corrected. . ' ' - - 

3.6. Tn.e KAIL project ' ' ' ^ ^ , /. 

D. H^bley and V/, Hansen have developed a high-Ieivel author 
language, KAIL, and written' a preprpcessor .which translates Kkiy into 
'T'UTOR. Several lessons have been written in tbe, new language. ' KAIB • 
adds structured control facilities to the-set of TL/TOR commands by 
means of "the '^selector", which combines flow of control with answer 
judging, and subsumes most of the currently popular control ct)nstructs ' 
(e.g., if -then-else, case, cond , while). 

The results of a recent experiment indicate KAIL's version 
of selection and iteration is easier to understand than more traditional 
syntax. These results are siiramarized in a technical report.. Another- 
experiment is ijx progress to compare KAIL's proposed means of lesson 
and help sequencing with those of TUTOR.' 

' •» 
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^ I>aria5 trie past acadenic year ACSES has been systematically 

introduced into our introductory courses : first in a small class for 
social scien<;e students (CS 103', in order to class -test, the FORTPwAJ: 
lessons; ther/<i laiige course for commerce students (CS 105). In the 
first case, a cont>rolled" exterrnent turned out unfavorable- to tiae 
PLATO group, for reason^ ve believe we uhderstand, "and haVe correcoed. 
In the second ca-se, results were favoraole both with. regard to stiment 
performance and attitude. Ve are trying zo validate this favorable 
impression by -means of a controlled^ experiment this fall. 
' These experimental evaluations' have be'en carrried out by """^ 

R. G. Montanelli,, Jr. , some in cooperation idth Esther Steinberg of 
the CERL evaluation group. _ \ 

They are |ow described in more detail. ^ 

(li. In ^e Fall Semester -197^; CS 103 class of about 60 

s-tudents) was randorpjr divided in half for an experimental evaluation of 

Ha 

the FORTRAN lesson ^uence. The control group received two lectures 



and -one discussion (|i*meeting in, a small group of , about 15 students^ 

it 

vdth a teaching assistant) per week, as the course has always been 
taught in recent history. The, experimental group had one^of tne lee^ures • 
replaced by an :hour on PLATO, to learn FORTRAIT. ^ The two groups vere 
ther^-eompared on various measures during the semester. 

Results indicated that the experimental group performed worse 
on all three exams during the, semester, although there were no differences 
on scores on computer prograjriming problems. However, students remained 
interested in and enthusiastic about PLATO in spite of their deficit 
in performance on the exams. Also,' there were- no differences in drop 
rate between the two sections. 



student questionnaires and inxerrie«s indicated several 
possible reasons for the poorer performance by the PLATO group. 
Several of these vere: (a) lessons not available because of lack ol^ 
memory to load them, (b) errors in lessons, and (c) lessons too long* 
In addition, Esxher Steinberg from zhe PLATO PEER group reviewed many ' ^ 
of the lessons and reported that some of them vere lacking in student 
interaction. Tne firsx problen was caused by a. lack of ECS which 
essentially prevented students from making up lessons at odd hours 
cr even fron reviewing (or going ahead to) other lessons during 
scheduled" hours - These probleras were alleviated by the addition of • 
more memory -in January, 1975* In response to the other problems, 
many lessons were corrected and revised, and a few have become the 
object of experiments to determine what makes a good PLATO computer 
science lesson. 

/ 

(2). In Spring 1975; CS 105 (a class of 600 freshmen, in the - 
College of Commerce , and Business Administration) students spent about 
90> minutes a week on PLATO. Fifty minutes replaced a lecture, and hO 

% - 

'minutes \rere spenl^ using the interactive compiler to solve a sm^ll 

) < 
programming problem. Although there was no course-wide experiment 

conducted, the results v/erfe more positive than the previous one. 

Performance on the first, two hou;* exams seemed to indicate that students 

learned more than they had in past CS 105 courses. (This was based on 

the assumption that. exams ftom one semester to another are roughly 

equivalent.) These resuits are in spite of the fact that PLATO was 

down for essentially the first ten days of the ^semester due to hardware 

problems. In order to obtain a more valid measure of student achievement, 
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xtl'ie' final exan '^as a modified version of the exam used the previous > 
semester, *?or several reasons *tais ^-as thought to be a safe proced'jjre, 
in that students would not have access to the earlier exa.^. Tnese 
reasons vere: (i; final exa.T.s are not ret^irned; f2 • the exa.T.s v:ere 
not Dlaced in the library; (3; exans had never previously been reused; 
and the exar. was modified so that answers and details were different, 
even though the level of difficulty was not altered. The means on the 
final exan for the' two semesters were nearly Identical • Tnis was a 
further indication that the PLATO stUdents were learning a5 much as 
non-?LATO students. 

A questionniare handed out by Esther Steinberg to 75 students 
on April 22/ 1975, showed that most students were happy with the lessons 
and found them^ helpful. 

(3).. Current experiments on individual lessons being carried 
out in cooperation with CERL's evaluation group are continuing in CS 193 
this fall. In order to determine which teaching strategies are most 
useful on PLATO, comparisons will be made by implementing different 
versions of the same lesson. Some of the variables to be tested are: 
.quantity of exercises, whether exercises are optional or required,\^nd 
whether exercises shoulfi be scattered throughout the lesson or occur 
at the end. Preliminary findings indicate that while sljiudents found ' 
more frequent placement of exercises make a lesson more interesting, their 
performance on a quiz was not better than that of students who' didn't get 
the extra exercises. * ^ 
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Activitie 3: July, 17^5 - ^une, lyr^ , ^ , ' ^ . 

^ 7 ' f 

u.l The library of lessons ^ 

Our library has expanded to about 1<5 lessons/ Tne er.phasis 

this year has been on making Lnprovements to certain of these lessons, 

'T)>"-fmarily ^he FORTRAN lessons-; for use in our own courses. Sone lessons, 

V*oso ^otably for^do, have b'^en compl^tfely rewr.itterf after usage experience 

has shc-^ that the initial effort' was cosuplet^ly unsatisfac^or>^ 

\ A-'nonr the more significant new ^ddi^ions to zhe library are . 

a smail series *of lessscns on Systen: Procrarriing, written by or under 

the direction of Axel T. Schreiner. Several of these were used by 

Schreiner during:' the Spring 19T6 offering of CS 32?, Operating Systems'. 

Vh^se 'lessons are primarily "lab" lessons, in which the students can 

set up and nln - small system (e.g., a dispatcher ''using semaphores for 

task syncronization) , and then watch the system run. 

Computer assisted prograinming system (CAPS) 

- CAPS is a highly interactive'^diagnostie compiler/interpreter 
that allows beginning programmers to prepare, debug and execute fairly 
simple programs at 'a PLATO terminal. Complete syntax checking and most 
seijtf^ntic analysis is performed as the program is enter,ed and as it is ^ . ' 
subsequently edited. Analysis is performed chara'cter-by-character.. 
^ ' ' The most remarkable feature of CAPS is its ability to autom^vtically 
• diagnose errors both at compile-time and at run-time. 'Errors arc -not ^ 
automatically corrected.' Instead, - CAPS interacts with the stud^^nt to help 
him fi^rf the cause of his error. * * ^ 
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Under CAPS many languf^es (e-g/, FCRTMN, PL/1 and COBOL) have 

l?een .implemented and sorr.e ha/e ^eefrHioed in elementary programming l^n^are 

courses. These implementations have shown that CAPi^>^orks vell^^ many 

respects and that th^ design aims of the. system are peri^eG^)*^^' adapted to 

the educat^'ona.! errvi^onment . Unfortunately, in the aspect of real time ' 

peformance, ^AP3 falll veil below acceptable levels. ^''^ 'Therefore, the 

development effort in tne past ^ear has concentrate^^ on improvinr^ the, -'^^^ 

perforr.ance of 0AP3 both' duriru3 P'rpf^r^Pi e^r^y and durinr, pronram execution^ 

To understand the deyploioment let's review the organization of the - 

\ « • • 

comoilers. * ^ ^ 

-. ' ■ r- ■ ' ■ 

CAPS comoi'^er orranlzations ^ 

" ' V ' ^ — • , ' • , 

. Each corrrpiler in the CAPS system consists c>f interpretive t^^bles 



specific to the language b^l^ig compiled; -common driving routines to interp|p,t' 

these tables; and a few routines, specific to the languap^e, ihaV/^.i^ ^'nilcd. * " 

• . 1 • . v"* \ . ; 



from the interpreted tables. \ These tables are built from asr,^5J^h3.$^^ik.c 



source code written by a compiler implem^citor.. After gehej^atfioft./ tb<is« ^ 

■ . ' ^ * t ; . Vt' \ ; • ; 

tables are\stored in 'common where they a^e loaded into -'^t^c'^* Y^dlrikbl<?^ an ' 
needed in compilj.ng student programs. ^ - # *" 

■ ^ : p • :; V ■• V . •• 

^ ^ Flow of control in the CAPS compilers is-'jshh^^m'.wi. Figure ,1. . Iht* • 
editor looks at each keypress the student enters fr^rj) 't?be •teminai.*^ I-f. 
the key indicates a text editing function, it is performed by tiie edi^br^ ,^ 
If 'the , student is- Entering oew , text, 'each Iceyp'ress- i.e. panned m to' the " 
.lexical ^alyzer. V/hen the- lexical analyzer receives -a "e^^wpig^e.; i^o1i:'Gr^;/ ,i/ha^ 
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Figure 1: ' CAPS Compiler Modules, 
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ucken io pacsed cn tc the 3>T.tax analyzer acd part or fcr coripili^ion. Sir^e 
each ke^'pre^s is processe-I as iv is entered', zhe cc^piler can r>ve Ira-*^ it^ 
error r.essages vnen ^ne student enters an invalid lanrua.^e construct. 

V.lule cor.pilini^ new text, "Trace" infcrraticn is stcre^l, allowinr, 
the Reverse Editcr to 'incompile the student's pro^rar^ as the student backs 
up to make a chanre. Occasionally the stora^te area fcr Trace information 
gets full. V.^ien this happens,; a compression unit is called whicn re.TiOves ^ 
alternate entries, frcr; the Trace tabl^. After conprec'slon is perfcrr.ed, 
the re/erce editor can only back up to alternate tokens. If necessarr, 
it will bac.< up* to the orevicus token and Vnen forwarJ^ ccjinpile to t*ie 

r 

current token. In practice, the coripxession routine mo^ pe called three 
or four tines for a student program. 'After four calls, there is Trarc 
information for one out of every l6 of the first tokens entered. Closer 
to the '^cursor** v;here the student is working, the Trace information is 
'available for/ every token, or at least alternate tokens. 

The lexical analyzer and the parser are both table driven. The 
table for the lexical analyzer is a state trarisition dia;;rajn interpreted by 
TUTOR code^ For example, if currently in the node of the diagram for 

* ■ I 

PL/1, a follov/ing * = ' causes transition to another node, while,, a following 

0r IS an error noted by 'the lexical ariaJLyzer. Conversely, in 
BAS/C /< >* is the "not equal*' token. I ^ 

The tables in the Par'ser are not .just a state transition array/ 
as in the lexical analyzer, but consist of internal codes intarpreted by; 
TUJOR unit in each compiler. This Interna^^code is complete vAth aritlimetic 
operations, con^ditional .jumps, calls to error routines, and calls to the 
lexical -analyzer tp receive the. next token. Thus the studenl^ wjiites in 
PL/1, for example, and his program is^ compiled bj^ cbde»*Deing interpreted 
by TUTOR code being interpreted i>y PLA^O run time routines.* 
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Cor.piler j-iita c^tr ct.rer 

The CAPS corpilers use ''^ .r<r,on\?or rcir/.crs and tallies sJv'.rOi j y 

a|Ll users of one ccr.piler an:: "stcra':e" for all pointers and tables needed 

bjy an individual U3%r» rev^ if anv^ of the student variables are used by 

» 

the corpilers. Portions oT cor^iOn anr^ storage jr*ay ce loaded into l>OC'-nc' 

variables in central menor^*. Hovever^ at nost three area? of each n^.y ae 

loaded at once. As sliov-n in Figure 2, by arranging the data areas in LCS* 

carefully, it was possible to meet this three-area restriction and still 

get the tables in desired locationc in central ne.TiOry. However, the 

'lexical and parse tables are each '-00 wordr> lonr,, and only one of tr^er. can 
■» 

be loaded at once. ■^Tnis is s^.3nlfzcant sin?e the coripllers spend 6''^ of 
their tine changing; the loading arrangen;ent . ) Fir^ure P shows tlie layout 

' of these areas. ' 
Possible improvenonts 

Four s^jr.gestions for improving the CPU time renuireraents of the 
editor have been made. The , first involves --minor receding of critical 
sections of the compiler and would give a minor improvement in speed. Two 
sucil changes are to 1) stop displaying the "space ]eft" indicator on the 
student's screen --'2.yh improvement, and 2) stop doing unnecessary -stolo 

'^commands-r2'^ -speedup. (The compil^er is ree;<ecutin(; the'same -stoload- 
command once for every token,' which is unnecessary, at least for the PL/1 
compiler*) 

' The second suggestion involves receding the lexical analyzer or ^ 
parser in TUTOR ^ rather than having TUTOR code interpret these tables. ' This 
would give an unkno^^m amount of speedup5 estimated at 2^ for the lexical 
analyzer, more for the i^arser, but reduces the generality of the driver 
program* 

/ 
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Ine thiri '-ethod propose: for Spociinf^ up the editor i3 to rr'^ce'^^ 
one line of rource tey.z av a tirre ravher trian one onaracter ^.t a.ti*^-". 
^'nis no /es the oclleotior. prooess frcr. the T'TCR le.'^!:on to the PLA.TC rvGt^-'^, ^ 
and allov's ^he'user correct errors -m his curre^^ line before givin^ it 
to the lexical e^.a^yzer ano parser. This rse^nod nac teen inpler.eritea and 
tested, and does reduce the C?V 'tine used, but the svster. is then ur3i>lc to 
respond iiTiT,ediately to an invalid cnaracoer or to<en. 

The fourth r.ethod suj^ested is to rr.ove se/*antic checrcinr and ^jTr.bol 
tabl^ construction to a later pass. Tirrrin'r terts conducted by L. '..'hite • 
sUf^^e.'^^^j anticipated irprover.cnt is orccahly rncre thnn rOr. 

Cf the four po.^slblo i-'iprcvorients, tnis lac-t Is least obv^cticnable 
since it retains the -taole-driven nature of the CAPS editor and still per^.it^*. 
in^stantarjeous an?llysis of r.any. errors commonly made by the prorrai^-.inr^ 
neophyte. ' In adJition, tne second coHipiler pass permits ^;eneration of a. 
representation of the program that is more pasily interpreted so tha^ 
execution speed is improved as well. . / 

: ^ . • 

V/or]: in pro;^r^ess. 

In the past year, S*. Nakamura has implemented an experimental * 
FORTPAir coinpiler using the two pass organization with encouraging resoltf5. 
^ His compilef is diagrammed in Figure 3« < ' 

Para^lleling fiakamura's experimerttal compiler development is an 
effort by T.-^Fishnian t-o improve the parser module of the editor. The 
current parsing tables must be programmed by the compiler-wit er. Considerrible 
knowledge and effort is required to implement, a lanr,uage and the process is - 
prone to error. Since, in the >q.organized editor^ the parser ds responsible 
only for syntactic details, more formal, grammar-driven parsing methods^ are 
possible. In particular, Fisliman is investigating the possibility of using an 

• ; 31' • ' • ■ [ 
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LALR ]iarsinr, technique in CAPS, lij a3vantares of an lALR parser Iz 
Doth the parser and the^parsin?; oablc vill be r.ore cor.pacr tnan the 
current parser and ^he table can be constructed directly frt.'n'the fcrr-'il 
grajnma^ specifying ohe programing >an<3UJ5ge. 

Tne output of tne new parser will have r^ore of the syn^ac^^ic 
structure of the prograni built inoc the intermediate text, vhicn -.^'ill 
perndt the editor to deal directly v/iuh syntactic units sucn as statements 
and 'expressions. 'As long as these syntactic ^onits *are left intact during 
editinc:, the parser vill not have to be called to ijnparse them as the cursor 
roves past. 

Tne structured intermediate text should alec permit tne Gcconl 

p^iss to be table'-driven to a t>reater extent tiiat it is now. ^B. Speelp^nninr 

is currently revisin^i HaVwawra's FORTI^AI^ compiler to use the output cf 

• V 

Jishnan's LkLP. parser to r.a>e use of this structure. 
Cone I'-S ion 

The atte-^pts by I^akar^ara, Jishnan, and Gpcelpenninc ore erfential 

to the ccntinued existence of CAFG at i-ts current level of diagnostic 

assi^tanc^i. Sxperi^cnce has shovnn tnat in its orininal formulation, CAPS 

v;oriid Intolerably .slow in. rigorous classroom use and this dep;raded 

performance is directly a consequence of providin^'^ enhanced diagnostic 

^ssisti^Hce. So should the current research prove fruitless, we must conclude 

i ' ' 

that at the^level of CPU processing currently 'available, the desired leve]\ 
of automatic error diagnosis is xj^iattainable on PLATO . 
^,3' Exam system 

The Generative Exam System devqlopqd by L. V/hitlock is a <:ompletoly 
interactive system for construction and administration of examinations, 
rearing a single terminal session, the system can administer an examination, 



grade it," and allo^^the' student' to compare his answers with the correct on^n. 



r:xaj?iinrition prc.olc-;r> are r^er^r.ei . : cne rvote-- acccriinf: to rroclf.^^^t i^-nr 
written by an inc^rjctor. Y.nalysoc • : 3tujent r^-r f-rranco, clic- pc'i:\rrir-' 
ani exar^inations are also proviaed ..y zne sy^^^er:. 

Figure ^ is a clock diaj^rar. of the irjajor components of tne 
Generative Sxari Sys^en. All users e-nter ^ne -oyster tarouj^h ^he Tonitor. 
'StudenoS ^ake and re^/iew exa.T.s in the Exam Adninis tration section. 
Instructors write exams in*the £xa.Ti V.'ritinn section and work vitn ex^in 
results in the Exa.Ti Statistics section. Problem C^nerator/Gra iers (pcAs) 
provirje tne-proclens for tne exa^.s. Eacn pr/,i handler all aspectc of a 
problc--. 6-:cept data storrir*^; it ac-cists an icrtrj^tor in \;ritir.3 nro'-ler 
specifications, cen^;rato5 a probleri for each -.tudeni, ad ninisterr: an-; r.radcr^ 
that problem, reviews it with tnre student, and col3 ectj^ data for improvinr, 
future problems. j 

vrnen a user first enters tiie Exanfi System, he is allocated a 
rer:ord in the Stu^ient Records data area- and a permanent storage area for 
his worK in the»Student Exiams dat& area. The system, differentiates between 
• two kinds of ii3er3--student and instructor- An instructor has access to 
both. student and instructor options v;hile all other users have access to , 
the student options only. An instructor writes' an exam by writinf^ problem 
specifications for each desired pg/g. Ihis .set of problem specifications* 
is assembled into an exam specification anrJ stored in the. Exam Specs data 
area. V^en a student takes an exam, the appropriate exam specification is 
transferred from the Exam Specs data base to the.ctmient's permanent .''.toraf.e 
area in the.Studerit Exams data base. The s'ame .area is used to reco^rd his work 
as he changes from problem to problem. / \ 

'This pa.^t year pg/fj's have been written for many aspects of FORTRAN 
V/ith these, various versions of the system have been used to rjlve not-Por- 
credit exams in several introductor:/' co;nputer science courses, and pp.rt of 
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for-credit exaninauions in two courc^-o (C? ICl and 103^ ^ii-' '^•^-^ 
popular with students)' use of th^ -system has been to provide pra^ctico 
examinations Just prior to paper exa*ninations ; students may take theco 
as often as the^r like. 

I>jring early experiments ;.'ith the '-system dt vas noticed that ' • 

• , # 

student^ were spending roughly twice as lone on PLATO exomc as they vould 

« 

on art equivalent paper exam. Analysis of video tape of fpur. students taking 
an exam on PLATO and on paper revealed that Uo1o -of the time was' due t6 quirk 
of the system ve have since eliminated; 25^ is an unavoidable artifact 
(mostly terminal speed]; and aaout S^'l-vas due simply to longer ohink-time. 
This think-time may result from an unconscious e>;pectation of an Lmmodiate, 
irreversible grade; though this is 'not the case in the ex'am system, it is* 
usual in other instructional uses of PLATO. 

Our major experimental effort of _the past year has been an 
exploration of alternate sbyles of examination, based on a set of pg/g's 
,vzhichjcan generate pro|plems to a specified "difficulty level". In a 
"gambling;" style the student chooses a difficulty level indirectly by 
s pec i f y i ng , i'o r'^each- pFob lem , what per^gntage of the maximum points he 
would like to t,ry for. ^ In a "tailored" style, the system adjusts the 
difficulty level on the basis of the student's prior performance on the 
problem. At a minimum, the tailored sty^e. eliminates the problems 
attendant on givin^j ,an examination that is top hard or too-easy. 

Initial iresults. show that the ^tailored exam subjects got more - < 
points than any other group^ even though maximum points can only be achieved 
by correctly working a problem at the higher,t^dif f iculty level. In response 
to questjr^^naire^ students shov;e<l preference for the tailored style. 
Expein^inents are continuing. 



In an effort related to t.*e e/'am cynten^ a .special qui 7. G:/">t<^n 
has been d,eveloped vhicn enables presentation of a criterion-referen'?^'! 
quiz follovinG a ?L'\'?0 computer science lesson. Designed ^and implenontefj 
by R. Anderson- fron a concept proposed by R. I'ontanelli; the system ccnsistc 
of a central system ir.onitor and numerous 'Jquiz renerator/graders", e.ich"of 
the latter generating quiz questions and grading them in a manner identical 
to .that of the problem generator/graders of the exam system. 
. The system provides a means to: 

- asvsess tne completeness and effectiveness of inat^rtr^icn v/ithin 
"""^ ^-pLfXTO Co lesson. Locn quiz is developTBd from tue job^'octivo: 




which produced the C3 lesson which it follows, thus sr.udent 
responses accumulated by a quiz should identify lessort errors 
a^nd deficiencies as well as weaknesses in the quiz itself. 

- facilitate student learning of lesson content. Alterations to 
bota the lesson and the quiz based on the analysis of quiz 
question responses should yield a quiz that v/ill aid 3 student 
in determining what has and hasn't been 'learned from the 

- material fully Covered by t^ie lesson..^ 

An initial- trial of the system occurred during the fall semester 

of 1975 v:hen one quiz was presented following its corresponding lesson. * 

Responses accumulated for each quiz question clearly indicated lesson 

shortcomings which were later eliminated via additions to and the 

restructurihg of the lesson. ^ * . , ' 

/ * ' ' ' / ' 

V/ith the development of more quiz generator/graders, further 

trials /^ere attempted during spring semester <5f 1976. An experinj<^nt to v 

de-t^rmine* student performance tendencies on different types of quizzes was 

conducted. Data accumulated .by the quizzes* and' the experiment are 

currently being analyzed. 

37 " " 



3h 



ii.u ^utrornatio .'ul^in-;: of student programs - . ' ^ 

An automated system for InGtruction siicul^f-^lje" capable 61 rrakihr 
judgements and providing co.Tjnerits on student pro^-^rar^r, analogou's to tne 
role played by teaching assistants and graders in the' more traditional 
means of instruction. Our efforts to provide this capability have resulted 
in i) two lessons which ask the student to vrite fairly sophisticated 
programs and attempt to judge these programs lYiteractivjsly with respect to 
both correctness and good design, and ii) . the development of technqnes 
capable of automatically detecting anomalies in ^beginning student's pro^^.rams 
without knowledre of the user aLnorit'nm beipn implemented. 

A program by R. Danielson^ which e^cposes students to a dynamic 
^'example of the top-dowT) programming process by monitoring their attenrpts 
to write a PL/1 program for symbolic differentiation of a polynomial, has 
been, completed. PATTIE (Programmed Aid for Teaching Top-clown ^prograviming 
by InLeractive Example) mimics the action of a human tutor^ in that she 
engager the student in an in^ractive dialo^^judging the correctness of 
student-suggested refinements and providing hints and comments where 
necessary. ^ . . 

The tutor uses an^TO-OR graph as a model of 'the stepwise 
refinement process, which student and tutor traverse together in tke course 
of progr^ development. The interactive dialog is conductec^ in natural 
language, parsed via a key/;ord/pattern matching schemQ which is built -into 
the PLATO author language, TUTOR. This Simple scheme is effective {^jOfo of 
inputs understood) clue to the limited domain of -discourse. A small amoun^t . 
of testing of PATTIE with beginning students has .been conducted, and more is 
planned for the immediate future. w - ' ^ 

I ^ Tne other lesson is a sorting laboratory and program •verificat^lon 
system developed by P/Mateti. This system allov/s the student to write ai^ 

• ■ • • 3B" ' / / , 
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^rDitrao' in-plac^ sor^inr; prorram ia'a pfor^r^imrdnr language vivti spq<*t'i]r;r- 
designed sorting primitives.. A special ir terpreter then prqviden a/iynami<" 
display of the status of =the array and indicen durinr, execution. This 
laboratory is an excellent facility for underr>tand?nr^ the operation of 
various sorting algorithms^/ and experimenting vith different implementations 
of ofie particular algorithm. 

In addition^ the student may provide assertions about the state 
of the keys in the array; and the truth ^r falsity of th^se assertions is 
indicated during execution. The\student may submit complete*^ prograns to 
the program verification routines ^ vhich use the inductive assertion meth'Bd 
to* prove the program correct^ or prove it incorrect and prpvide a counter-' 
exaiT^ple, A special theorem provei;^ which is highly efficient in this ^ 
restricted domain, is the heart of the system. Unfortunately, vhile the 
verifier can prove or 'disprove a sorting pror.ram faster than any other ^ 
known program (for example, a babble sort routine is proven in approximately 
nine CPlJ-seconds ) , the severe "limitations on processor use imposed by 
' PLATO make uee of the verifier for actual instruction difficult (the 
same bubble sort may require as much as 30 clock-minutes to prove). 

\ t ' ^ ' ' ' 

I A third project is being cqnducted by V/. Gillett to automatically- 
detect program anomalies "(iTr-pi^cedural languages such as FORTi^N ov PL/L ) 
without knovdedge of the user algorithm being implemented. Data has been 
collected and is currently being analyzed to* identify and categorize 
programming '"defects'* made by. beginning pj5op,rajmners* Many of these 
"defects'' occar because the -st'iWent'N/iews his program as a^squence of- 

X , ^ Xv ^ X 

erl^tially independent statem^h^s instead of an integrated whole. 




Detection techniques based on. iterative global flow -algorithms 
-Irave been ^t^fWiPped. Even though the user algorithm 'being -Implemented 




is unkm-AT:, those -techniques ere caprille of 'i^3^^;^<Tr^ 

detail and can, irj man:/ cases, djro::';^^J;i^;^S^ resolution 
of "the "defeq^'^ 
uo rn^ KAIL Pj:^girG<^'^ 

D. Hhbley exT^Lcr^ experimental an^J formal language ues^i^jrand 
^Dbiied these, design metj/ods to an investi, Ration o^f ccmj^r^ contracts for 

interactive computinfj, particularly in compute;>'^!xtied inct+miction. A^^^ a 

\ 1 ^"^ / * 

meahs for exploration, I new CAI^authox^langua^e, rVuL/ was de3ir,ned. One 

V ^ ^ I ^ ' 

feature, the KAIL selectkr [ZTibley and Hansen 7^ I; *tianales - structured flow 



in iilteracti^v 
iteraiicn, it 
of control, YJ\ 



]ialocue3.\ Tnis con.struct not only unifies selection and 
ub:^u:nes CA\ answer Jud(unc as well. Por nohs^-ructured flow 
jtatic exception processinn scheme 5omev)ha^ 

similar to PL|1 

These centre! construct'^ were tested in two experiments conducted 
/ ^ 

on-line in tAe PIAt/ environment. The first {c^nbley TA matched the KAIl: 
selector aXinst/^ set of typical ALGOL-like constructs. The results 
indicate /hat subjects understood pro'grams written usin^ tlie KAIL selector 

at leas/ as well as and perhaps better than programs written using typical 

^ <^ * - , 

if, (>tise, and while Constructs. The second experiment* [Bnbley 76] 

... . ^ y — , . I i 

/ \ ' " * \ • 

Utilized the PLATO system to monitor subjects as they^_found and fixed proernm 
bugs and modified a suljstantial CAI lesson about 500 lin^s^^ii^^ length. Some 
subjects saw ^ version written in a TOTOR-like language, oth^s :fe§.w a 
version in; a KAIL-like language. Observtit ions basically sup^-bedj^ 
sequencing constructs, but"^ also uncovered unf oreseenwli-^lculties in the 
KAlL-like language. The results of tlie 'two experiments generally indicate' 
^thect the KAIL constructs are likely to be psycholof^ically sound. 

These constructs were also examined through a formal definition 
.of their semantics. , An airiomatic approach vras applied to the KAJL selector, 

V. 40 ■ 
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.and one surresvea oxuension vas fc ini to be an order of m?i>:nitude roro 
"ccmolex' Lhan.the basic selector, ctnoti-ucc. ^oth the* KAIL and tlies'I'TvI^ 
exception , processing scnemes /.>*ere defined in terir^ of a behavioral r.o^iel, 



end the xvo schemes vere ^^jjrpar^d, ^ne fornailisn exposed convex*: 
dependencies in TUTOR and showed vr^y programers are likely to find the 

V 

. TUTOR sequencing construats more^ difficult Ijo imderstand and use than 

the corresponding constructs m. rCAIL. ' • 1 

. • ^ . - ' , -J ^ . 

: As a result of the investigation three -basic design pirinciples 

'f ' * . 

evolved: unifo^nity, separability, and 'locality , ^ The uniformity -principle 

Suggests tna't l^anp^age3 cugnt *to ce designed vdth a cne-to-ooe rela^vicnchip 

between syntax 4r.6 semantics.. The separabili\-y princ irle, sugr.est:: 't.\^t 

special -purpose, ccnposite structures 'that ere only in'-Jirectly separable , 

may be harmful. Th^ locality principle feugg^fcsts that danguage^ features * 

should be as permanent arid local as pbssible. These, three principles are 

proposed-as a , partial basis for -the de^sign of prorramrrdng language features 

in general., . . . ^ ' ' 

• ■ • _ * 

t • ' 

^ 1***^ Use of ACSES in instruction * ' ' . ' 

' ; ^ 

' ^ PLATO is now in routine use in CS 101^ 102, 103, 105, and UOO for 
a. total of 1000-1200 students per seraester on the U of I campus. In fall 
1976, CS 101 and 105 v;ill each have one less professor assigned^ an ihclic^tion 
•Of the acceplfance of PLATO. Other i^ntroductory courses are in the process 
,of phasing in PLATO. • ^ . *^ * 

^ Also, there has been systematic .use of AC§ES lesson materials 

in six sections of three coursed at V/right Community College in Chicago, 
mainly under the direction of Kathleen Galway. The table belov; sunVnarizes 
this use fojr the fall 1975 semester. ^ * , 
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.with a PJjATO lesson in a large university class, a controlled experiment 
(described below)* run in fall 1975-^ Essentially the results indicated 
that pIATO students would strongly recoiTtmend PLATO sections to their 
friends, learned as much as non-PLATO students,, but dropped at a somev/hat 
higher rate. • . • , 

fl). Procedure 

In order to allow for testing some hypotheses about the use of 
PLATO in our introductory computer science courses, a controlled experiment 
was .designed for CS 10^, for fall 1975- Five lecture sections' were offered, 
with four of them arranged in the following way. Professor A taught a PLATO 
section (one hour on PI^TO replacing one lectiire) at 9'OOl am, and a non- 
PLATO section (tv;o lectures, rfo access to .PLATO) at 10:00 am. Professor R 
taught a non-PLATO section a^t 9*: 00 am and a PLATO section at 10:00. 
Professor C, who was in charge of the course, taught a fifth (PLATO) section 
in the afternoon, but it was not involved in the experiment. , It should be ^ 
note4 that this* author did not teach any sections, and tjiat neither professor A 



nor B iiaJ ever uceJ PL/tTO before tiiv 3ene3ter, An additional 'unor 
difference betveen tne tvc u'/T>es cf cections vas that the PL^IO stodenis 

• ■- ^ 

did their first tvo machine problems usiiig on-line PL'uO FORTRAN cornril-ers 
instead of the IBM ?>60. 

Before the semester becan, students* r^r,istraticns fcr^the fiv-e 
sections vere equalized (by the conp'^ter pror,ran vhich makes up q^dent 
schedules), so that there were equal nanbers of students in each section. 
Tnen students in the 9:00 and 10:00 sections were randordy reassigned to ' 



:ner 



lTO or non-?L 



Students vere kept seriarate by usinrr 



trie followinr r.echanis-^iS . 1' Sfr^cr.ts were not alloved to transfer -ect-icrs. 

unless it co'jld be -ione ^vitncut affecting the exp'?rircnt . .For exar.pic, a 

studer.t could net stay at trie san:3 nour and cnanfje sections. If a r'^/rient 

wanted to change from 9:00 to 10:00 (or vice-versa», he/she had to keep 

the same type of section (PLATO or non-PLATO).' .If a student wanted to 

switch from the afternoon section to a rorninf< ^section, he/she was randomly 

assigned to a FIATO or non-PLATO section. Stur]entr> were not allowed to 

\ 

transfer to the afternoon section. Any student -^o felt she/he co^jJLd not 
abide by these rules was sent to the author who attempted to convince her/him 
of the value of edu6etional experiments and of PMTO (There were about ten 
such students, and most wanted .'out of PLATO, presiomably due to having heard ^ 
about the problems from the previous semester). The result of these 
discussions ^^as that two students who protested violently against PLATO and ^ 
marines in general were allowed to transfer out of PLATO sections. 
2) Students in non-PJjATO sections were notj given access to PLATO, as a student 
record with associated name and code had to be created for .Qa;ch PLATO student, 
and this was not. done for non-PLATO students. 3) .Individual attendance was 
taken in the lectures intended for non-PLATO students pnly, insuring that no 



PLATO rtu'Jents Voulu enter. In crj-r to as:?en:; the effect of ^r.c^e - 
precautions, students were asked f.'ii a ent ionnaire riven to "^ll C'^'^"^-ntr 
inL-nediately after completing their C3 105"Tinal exams j if they had looked 
at ?:i^terials for the other group {they vere assured rnat there would be no 
penalty', fev^on-PLATO students hau3 seen some of the PLATQ ^naterials 
through friends or through naviuQ access throu^^h ottiy courses, and a few 
^.ELATO-etudenxs attended lectures, either through usini^the naine of a friend 
who was 'not attending or through slipups in our re-^ords. It was felt- that 
none of these minor disturbances would have, any major effect on re5.ults. 

The three o^^ctheses of this study were: ^ 
!• PLATO ctudentz ^ould enjoy the course rvore, and rive i> a str'cn.'^^'r 
recorjiendation to their friends. 

PLATO and non-PLATO students would perform equ^^l]^ well on exams and 
^homeworks in the course. - ' 

3- The crop rates in the. two types of sections would ue similar. 
'(2). ^ Results 

In -answer to the question (from the quest ionnair^^;Siisi«lstered 
with the final exam): 'I'D a friend were taking CS 105 next spring and 
*PLATO and non-PL/iTO sections were offered, what would you recon^end he 
take?* • PIATO students fetrongly recommended PLATO (112 circled 'definitely 
PLATO*, 83 'PLATO if convenient*, U5 had 'no recommendation*, 15, said 'lecture 
if convenient*, and 21 said * definitely lecture*. On the other hand\ non- 
PIATO students were neutral (their responses, in.ord^r, were/29; 22, 91, 26;' 
19), or even showed a slight 'preference for PLATO. 

•In grdeir to compare learning ^across groups, a- 2x2 univariate 
analysis of* variance v;as computed .for each ex'Bia and for tgtal points on » 
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computer pror^rans. I.'o significant differencer were fpund^ and '^.^^ans vero^ 
n'early Identical for the various fjroaps (Table 1). 

The third firpothesis concerning drop rates vas rejected^ hovcver. ^^x^, 
Professor A had 19 (1?%) drops Trcn his PL^TO section^ and bnly ^ (^^"^i from 
nonrPLATO. Professor B h'ad 28 (25%) drops from PIATO^ and l8 {Iht) from 
non-PLATO. > - 



Table 1- 
AveraFce Scores on Sxaris. 
and ^Machine ?rd;lems « 



('a; Machine l-roblens 
* 

Professor 
lb) Hour Exam 1 

Professor 

(c) Hour .ExamNS:^ 

■ Professor 

(d) Final 'Exam • • 



A 
3 



A 

B 



A 

B 



PIATO 



9? 

91, 



65 
62 



s non- PLATO 



91 

Q1 



6? 
'62 



Prof-iSSor 



A 
B 



135 



13^4' 



(3). Discussion ' ' . ^ ' .' ' " ^' 

Students in the PLATO groups v/ould strongly recommend that their 
friends choosS PLATO, sectionfej thu« confirmng the first hypothesis." Even 
if- the 'extra; 25 drops* in "the PU<m%^%ons. were stroagly negative^ they 



would h^ive'-^ zr,^ll effect on the'tcialz of ^-^v FLA: ' d^-ident^ r^^ofrz/r/iin - ' . 

FIATO^ end only of tlic^i re-:o?tr.c>;i;iing ic:tures* il saoMld be ro"rr.ar<'^-d 

tnat vhen the J^L/iTC students were ac?.ed to. in^-licate. vrj?it they thou;;Vit vere 

tne vcrs^t features of FiATS^ ?6 crteck^d 'Tlve.dist^nce -to CERL' ('-]nfort;.:«mtcl> 

the ternilnais are .locator? on .the north edge of <:ar.pu$ 'in Ch'RL^ about a 'rtiLe 

from most cpinmerce courses- )^ while "'-'T checked 'Lack of hur.an contact'^ /a!:^! 

31 chec-^ed 'PIATO going^dovn', the next tw mozt frequently checijed ret}p(^)^5ses 

Tnus tne major problen was unfortunately out of .our control. » ' , 

Tne second hypottiesj^s vac not rejecj^d. The nearly identical-; 

Scores or. exa^;s ana r^cnihe probiers. in fable 1 are evidence^ of tnat^ 

without refer^n^o to st'j^oioticG. iivere is r.o re.ason to svispect ^:1at ^ 

'the PLcVT^' '>op^ v-er-e pDOr. stiide>nt,5* ;:w^'*v^r^ if the dropped ?]J<.70 strident;; 

,wjere telcv. avera^ge, 'they OQUld net have had a 'larr^e er*ou(;h effect cn tne 

re^ifl^s to ai'ter.the obvious conclusion/ This jrec^'ult, is certainly ir. 
* * , *' 

agreement with -^ost studies of ihe effects of CM. In fact, vhen Ja'^ason^ 

Suppes, and Wells ^157^/ s^^veyed'tno effectiveness of * aitern^itive 

instructional i^edia, they stated: • ' * - * 

* •* t 

4 ' ' ' , 

*^ . the- e?:5ual-eff^ctiYene^£ conclusion secrris to be broa^iiy correct for 

rr.o^rt* alternate^ jnetJicds' of instruction at the ^college lev^ '--'^ • 
and suf.^ested stud^yin^^ .costs of various rnetnods of delivery. ^ Kpwev(?r, a 
major advarita/^e of CAI is that once used, it is not s^t in stphe like a 
textUQoK or movie. 'As a result of this^-exp^ri^ient', the two' lessons >iiich 

* ' * ' ' ' ^ , ' / ' ^ • ' ' ' ; ' • 

students, liked the leact are being rewritten *f rem 'ccrcitoij. Secondly, .a 
quiz system lias peen begun* \ihen qi^plG^^d, it wiXl pi^esent a quiz to' eacj'n 
student at *the completion of * each lesson. The' qui-7,zea. are.;noV vritten' by'"- ; 
the authors of the lessons, and in fact quiz autnorcf are aiscouraGCd from • 
lOokirife^at th6 lessbris* However, the quiz'zcs are ^/ritten./rom^ tne 'sajno ^ ^ 



cbjectivoo that vcro u3od to vritc *,,.C' les^cnc. Ine i-erultinr quiz --cores • 

i 

vill not only tell the students Acv; >ell they ^ondorstand >h^ n.?t^^rial/..inch 
the lesson is supposed to cover^ but vill tell instructors and lessor* 
autnors now well tae lesson is vorkin^;. Taus, coi:;tinual ir.provenent is 
possible, and pernaps eventually CAT natericils will -b'e as fzood as tne "-^est 
lecturer, and therefore better than nan^. 

On the other hand, the hypothesis about equal dr^^p rates v.^as 
rejected. This vas a surprisin^s result, especially vnen the sr.aller 
e/perir*ent a year earlier ^jnder worse conditions) slioved no differences. 
:ry^-9ver, the earlier course r.ay na'/v reen a special case«^^ Jt var a r:-lativ 
snail elective cc'>.rse with r.ainly .'unicrs ar>i seniorr in psycnclo.T^^ and 
similar fields. These students vere r.ore* invclveT and inter-ested in the 
experiment (as the author was teaching the course), and they nay havo' 
stayed for .that reason. On tne other hand, C3 105 required course 

for fresimen in the college of corrjnerce, and the students /ere presurr^ably 

i 

less interested in lon^^ term educational goals (for themselves as well as 
for the KJkTO materials). However, although this drop rate was disturbing, 
there were a few, ^likely reasons fot it, all of which could^be fixed. Foi^ 
one ^thing, the first three weeks v;jJre confusing for the students because 
they had pre-enrolled in a course which they expected* wuld consist of two 
lectures and a dii^cussion each week. Instead, three-fifths of them had 
a lecture cancelled and had to sign up for a PLATO section in'stead- These 
sectio/vs caused a lot of trouble, as some were scheduled for week-endri, 
and many students complained that- they were unable to meet any of the 
Vemaining' available PTAm-tira^. Although most of this confusion \;as 
necessary due to the nature of , the experiment, ia the future students 
will preregister for PLATO seqt^ns just as for any other class, A second 



possible oa'use for th'e different ur^D razez var^ that for the firnt f'^-'v' ' 
veeKs^ FIAXO students v*Bre *reauirej to do their pror.r-'vrranrj problemc^ jn 
one of the on-line, interactive conpilers. Althour,h it' was thought that 
this vould be fun for the students, ohe compiler nave very poor response 
Jtiine because of the ajnounu of processing goinf^ on to ?hecK for errors 



after* eacn student' ke;fpress, Finally, drop^ ^miGht have been due in part 
to student dis.^|^Gfaction vi'th the twp poor lessons which -v;ere later 
rewritten. Students had ndt been systematically polled about the lessons 
before, and the relatively negative reaction to tvo of them was qiiite 
surprin.ing. 

Another possible e:<^Lefnation for the higher ^Irop rate on P'^ATO, 

is that sor.e students (< lOt) are anti-machine ahd that CAI will alvrays 

have tnis problen. The author does not feel that the 'large differencer, 

found here could be attributed to^this reason. However, this 'is being 
* > 

checked during the current semester, because *the problems mentioned in 
the preceding p^rstgraph have, been fixed, and althounb no experiment is 
being run during the currept, semester (all five sections of C3 lOS'^^e 
using PIoATO), the current drop r^te could be compared-'with past drop rate 
in order to see if *ihe PI^O drop rate is as high as vas ^und here. 
(h). Summary * . 

PLATO lessons can be'used t"o replace one lecture a' v;eek in 
an introductory computer programming eourse. Students learn as much and 
prefer PLATO' to lar^e lecture, sections. The r^emaining problems are: 
1) Is there a higher drop rate on ?LAT|)? and 2) Can instruction .be ^ 
improved throligh continued development- of the CAI materials?" • 
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